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(54) Method and apparatus for analyzing Image data to use multiple transforms lor enhanced 
linage data transmission 



(57) A method and apparatus for compressing dig- 
ital image data to improve the efficiency of serial data 
transmission is disclosed More specifically, the present 
invention accomplishes image transmission by provid- 



ing multiple image processing modules, and then select- 
ing the module thai will process Ihe entire in the most 
efficient manner, based upon the content of the data 
contained in the imagG. Image content Is analyzed using 
hierarchical vector quantization. 
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Description 

[0001] The present invention is directed to a method 
and apparatus for compressing digital image data such 
thai data transmission speed matches the speed of an 
associated modem. More specifically, the invention ac- 
complishes Image transmission by implementing multi- 
ple compressors, each ol which compresses image data 
to achieve a different output image quality level. 
Throughout transmission, the invention continues to 
send the Image data to the compressor that wiD process 
it such thai an appropriate level of image quality will be 
retained, while simultaneously ouiputting ft at a speed 
that will result in efficient serial data transmission. 
[0002] The transmission ol electronic data via facsim- 
ile machines and similar devices has become quite com- 
mon, and efforts to transmit significantly larger volumes 
of this data within equal and even substantially short- 
ened periods of time are constantly being made. This is 
true not only to allow data to be sent from one location 
to another at faster speeds and thereby cause less in- 
convenience to the user, but to enable more complex 
data to be transmitted between the same locations with- 
out drastically increasing the required transmission 
time. For example the facsimile transmission lime for a 
detailed halftoned image will be many times more than 
that ol a simple sheet of black text on a white page when 
using the same fax machine. By the same token, fax 
transmission of a color image will require an even great- 
er amount of time than 'its greatly detailed halttoned 
counterpart 

[0003] The 'sending' portion of fax transit. ,3ion in- 
cludes scanning the original image and generating a 
corresponding digital image thereof, followed by serial 
transmission of digital image data to a receiving fax ma- 
chine. Without any form of data reduction, transmission 
of color image data files via facsimile would require ex- 
tensive resources - very fast modems and/or large buff- 
ers - and would stilt take a great deal of time, thereby 
causing such transmission to become very expensive 
and therefore, impractical. Thus, some form of data 
compression is typically employed prior to fax transmis- 
sion of color hnage data. 

[0004] The JPEG (Joint Photographic Experts Group) 
standard providas a wall known method Of compressing 
electronic data. JPEG uses the discrete cosine trans- 
form (DCT) to map spatial data into spatial frequency 
domain data. Briefly, first JPEG requires transforming 
an 8 x 8 block of pixels into a set of 6 x 6 coefficients 
using the DCT to produce a DC coefficient (DCC), and 
a set of AC coefficients (ACCs). The DCC and ACCs 
are quantized, rounded to the nearest whole number 
and arranged in a one dimensional vector which is en- 
coded into a bit stream. 

[00051 Because color image data is so complex, ordi- 
nary data compression schemes require high compres- 
sion ratios to be applied in order to complete the trans- 
mission within an acceptable time frame. Higher com- 
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preGGion ratios lead to more data loss, typically at the 
higher end of the frequency range. 
[0006] Successful fax transmission requires a proper 
correspondence between the compression ratio being 

& applied to the image and the CPU speed of the sending 
lax machine. In'other words, if the compression ratio is 
smaller than necessary for a given CPU speed, the CPU 
will have lo be slowed down, or the data will have to wail 
to be transmitted and an appropriately sized buffer will 

io be required. On the other hand, high compression levels 
mean that very few bits will be generated and less data 
will have to be eent through the modem. If the compres- 
sion ratio is high relative to the CPU speed the modem 
will become idle waiting for the CPU to complete image 

1S processing and transmit more data. Since modems are 
typically configured to detect a large lapse in data trans- 
mission as the end of transmission, this large idle time 
typically causes the modem to disconnect. Thus, it is 
advantageous to continue the stream of data from the 

so sending fax machine to the receiving fax machine, and 
eliminate gaps In the data stream. One way to do this is 
obviously to implement a faster JPEG compressor 
Which can keep the data moving through the modem 
even 9 a high compression ratio is used. However, this 

25 solution results in significant cost increases and may be 
impractical. 

[0007] One way to maintain proper compression ratio 
to clock speed correspondence is to provide multiple 
compressors to which portions oi the digital Hnage data 

so may be transmitted. If the portion of the image being 
processed contains a lot of pictorial or other data that 
requires high quality reproduction, that data should be 
processed by the compressor which will provide the best 
image quality. However, if the portion of the Image being 
processed contains text or other data thai does not re- 
quire high quality reproduction, that image data can be 
routed to a compressor that will produce a lower quality 
output to benefit from the fact lower quality output can 
be produced by the compressor at a much faster 

40 processing speed. In fact when text or other simple data 
is being processed, differences between image quality 
that is produced by a high quality output producing proc- 
essor and that produced by a lower quality output pro- 
ducing processor will hardly be noticed by the human 

4S eye. 

[0008] An pixels, and therefore blocks of pixels, are 
defined using a certain number of bits. In an image 
processing operation known as vector quantization 
(VQ) , a block of X x Y pixels is mapped to a single 'code- 
so word* 1 which is defined using a smaller number of bits 
than the number required by the original block. Code- 
words are stored in transmitting, recervhg and storage 
devices, and each codeword is associated with a pre- 
defined set of image data. The codeword to which each 
5? pixel block is mapped is that which is associated with 
image data that most closely matches the image da la 
in the pixel block. The typical process includes mapping 
the pixel block to a codeword, storing the codeword or 
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transmitting II to a receiving device, and Ihen mapping 
the codeword back to image data when It is retrieved 
from storage or received at the receiving device. Since 
codebook storage and codeword transmission require 
tess space and lime than storage and transmission of * 
original image data this process greatly reduces the re- 
sources required to reproduce the original image data. 
[0009] There are typically many more combinations 
of pixel blocks than there are available codewords, and 
as indicated by the term "quantization" several input 10 
blocks can be mapped to a single codeword. For a fixed 
number or codewords, increasing the size of the pixel 
block reduces the quality of mapping and reconstruction 
since more actual Image data must be mapped to the 
same number of codewords. Some drawbacks of VO 18 
are that codebook design is often very complex, and thai 
large amounts of time ere usually required to search 
through the codebook and to match blocks to the appro- 
priate codeword. Whife codebook design can be per- 
formed off-line, block matching searches must be per- 
formed on-line. 

[0010] In hierarchical vector quantization (HVQ), 
block matching searches are performed two samples at 
a time. Thus, look up tables (LUTs) can be used directly 
to perform HVQ in two or more staged. In the first stag a, 25 
two image pixels are mapped to one codeword, reduc- 
ing the number of samples by a factor of 2. In the next 
stage, the process is repeated to map pairs of code- 
words to single codewords. Preferably, codewords are 
grouped in a direction perpendicular to the one used lor 30 
the previous level. As the process continues, the result- 
ing codewords are mapped to larger and larger amounts 
of data, 

[0011] HVQ allows tor a rough approximation of the 
content of each image block using simple look-up table 35 
operations. The final codeword represents a block ap- 
proximation and can, therefore be directly mapped to 
other quantities which describe certain characteristics 
of the approximated block, such as block activity. HVQ 
codebook design methods follow standard VQ code- 40 
book deeign algorithms and is usually performed by de- 
signing the codebooks for a Bingle stage at a time. 
[0012] The following disclosures may be relevant to 
aspects of the present invention: 

[001 3] US-A 5,699,457 to Ada r et al. issued Decern- 43 
ber 16, 1997 discloses a method of bit rate control and 
block allocation for discrete cosine transform (DCT) im- 
age signal compression includes the steps of (a) parti- 
tioning the image signals in blocks representing portions 
of the total Image, (b) calculating DCT coefficients for so 
image data In all blocks, (c) obtaining a measure of block 
activity (BACT) for each block based on DCT coeffi- 
cients and for the total image activity (ACT) as a sum of 
the measures of all block activity, and (d) determining a 
code allocation factor (AF) for each block based on the ss 
ralloof btockactivity (BACT) to target cod e volume (TCV 
data) for the coded image data. The method also in- 
cludes (e) allocating bits for each block using the alio- 
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cation factor (AF) for each block and the target code vol- 
ume (DCV date). 

[0014] US-A 5,699,170 to Yokose el al. issued De- 
cember 1B t 1997 discloses an image communication 
system wherein transmission of an image between an 
image transmission apparatus and an image reception 
apparatus which include image output sections having 
different performances can be performed without mak- 
ing an inquiry for the performance prior to transmission. 
An image is inputted by an image input section and sent 
to a hierarchization section in the image transmission 
apparatus. The hierarchization section converts the in- 
putted image into hierarchic communication data and 
transmits hlerarchized data to a selection section of the 
image reception apparatus. The selection section ex- 
tracts only necessary data from the hierarchic commu- 
nication data transmitted thereto in accordance With the 
performance of an image output section of the Image 
reception section and then sends the necessary data to 
the image output section after, it necessary, they are 
converted into image data. The image output section 
visualize the image data transmitted thereto from the se- 
lection section. 

[0015] US-A 5,642,438 to Babktn issued June 24, 
1 997 discloses image compression implementing a fast 
two-dimensional discrete cosine transform. More spe- 
cifically, Babkin discloses a method and apparatus for 
the realization of two-dimensional discrete cosine trans- 
form (DCT) for an 8 x 8 image fragment wfth three levels 
of approximation of DCT coefficients 
P016] US-A 5,341 .441 toMaedaetaL issued August 
23, 1 994 discloses method and apparatus for coding im- 
age Information, and a method of creating code books. 
A coding apparatus divides digital image information In- 
to pixel blocks each having a size of M x N pixels, and 
subjects the image information to vector quantization in 
btock units. The pixel blocks are orthogonally trans- 
formed and the characteristics and sequency compo- 
nents of the pixel blocks are detected. Each pixel btock 
is divided Into a plurality of eub-bkxks in conformity with 
the detected sequency components. Respective ones 
of the plurality of divided and outputled sub-blocks are 
scalar-quantized into sub-vectors of a predetermined 
number Of bits in conformity with the characteristics Of 
the pixel blocks. Respective ones ol the scalar-quan- 
tized values of the quantized sub-blocks are vector- 
quantized in conformity with the characteristics ol the 
pixel blocks, these vectopquanllzed reproduction vector 
codes are combined and the result is subjected to fur- 
ther vector quantization. 

[0017] Pending US Ser. No. 09/075995 filed on May 
12, 1 998 by Ricardo L de Quelroz and assigned to the 
assignee of the present invention discloses an encoding 
and/or decoding method and apparatus which incorpo- 
rates decoding commands into a compressed file. The 
decoding commands are instructions carried along to a 
decompressor and implement processing performed in 
the compressed domain. Then, the decompressor proc- 
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esses the data while decompressing It. This reduces the 
compulation time tor imaging operations. 
[0018) Pending US Sen No. 09/1 1 9023 filed on July 
20, 1 998 by Ricardo L deOuelroz and assigned to the 
assignee of the present application discloses a method 
and apparatus for compressing digital Image datato Im- 
prove the elflclency of serial data transmission. The In- 
n!p«**^ v iG*W'- ' venljpn accomplishes image compression by perform- 
ing Ihe most complex portions of a standard compres- 
sion technique on a smaller amount of data than the usu- 
al 8 x B block of image data. The invention includes a 
fast JPEG compressor based on a modified two-dimen- 
sional discrete cosine transform. 
[0019] Pending US Patenl Applications identified by 
attorney docket numbers D/9B011 and D/98011O to 
deQuerroz et al. entitled "Method and Apparatus for Us- 
ing Multiple Transforms to Fill a Buffer for Enhanced Im- 
age Data Transmission* and 'Apparatus for Using Mul- 
tiple Transforms to Fill a Buff er for Enhanced Image Da- 
ta Transmission* both assigned to the assignee of the 
present invention disclose methods and apparatus' lor 
compressing digital image data to improve the efficiency 
of serial data transmission. More specifically, the inven- 
tion uses a buffer to hold processed image data until the 
modem is ready to transmit it The amount of image data 
residing in the buffer is continuously checked, and one 
of several image processing modules is selected to 
process the data based upon the volume of data that 
resides in the buffer, 

[0020] Accordingly, although known apparatus and 
processes are suitable for their intended purposes, a 
need remains for a method and apparatus »halca ".ffi- 
cJentiy process digital Image data and fmprove the effi- 
ciency of serial data transmission. 
[0021] In accordance wfth one aspect of the nvention 
there is provided a method of improving the speed and 
efficiency of electronic data transmission, which in- 
cludes the steps of acquiring input image data which 
represents the light intensity of an image; segmenting 
the Input image data to form a plurality of image data 
blocks; selecting, based on an image content, a module 
for receipt of an Input Image data block; and processing 
the received image data block In the module. 
[0022] In accordance with another aspect of the in- 
vention, module selection in a method of improving the 
speed and efficiency of electronic data transmission in- 
cludes obtaining an (mage data block; mapping the im- 
age data block to a single codeword using at least one 
look up table; and transmitting the image data block to 
a module which has been designated by the single 
codeword 

[0023] in accordance with yet another aspect of the 
invention there t3 provided an apparatus for improving 
the speed and efficiency of electronic data compression, 
which includes a 6egmenter which divides image data 
into a plurality of input image data blocks, wherein ihe 
image data corresponds to the fight intensity of .an orig- 
inal image; a plurality of image processing modules 
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communicating with the segmented wherein any of the 
modules may process the segmented image data 
blocks; and an image analyzer communicating wilh the 
input image data blocks and with the modules to desig- 

5 nate one of the modules for processing of a segmented 
image data Wock, based upon a content of the segment- 
ed Image data block. 

[0024] In accordance wilh still another aspect of the 
invention the image analyzer of an apparatus for improve 

10 ing the speed and efficiency of electronic data transmis- 
sion includes an input data mapping device which maps 
each image data block to one codeword using a look up 
tabic; and a director which transmits the image data 
block to a module which has been designated by the 

1$ single codeword. 

[0C2S] The present invention deals with a common 
problem in digital image .processing systems - obtaining 
an effective yet cost efficient way to supply a continuous 
stream of complex image data from a sending fax ma- 

20 chine to a receiving fax machine. One way to solve this 
problem includes using multiple compressors each hav- 
ing different data compression rates, and selecting the 
appropriate compressor for processing blocks of the im- 
age data based upon the content contained therein. 

2S Specifically, If the activity in the block is tow - there are 
few variations between pixel values In a single block, 
the image data will be processed by a module that proc- 
esses data al a relatively high speed, even though some 
image quality may be lost If block activity is high the 

39 data will be processed by the module I hat will produce 
the best image quality, albeit at a slower speed. While 
some areas of the original document will be reproduced 
at a lesser accuracy level, the overall qualEy of the out- 
put fax will be sufficient for most purposes. 

6 [0026] oiher fealuree and advantages of the present 
invention will become apparent as the foBowin a descrip- 
tion proceeds and upon reference to the drawings, in 
which: 

[0027] FIG. 1 is a generalized block diagram illustrat- 

40 ing genera! aspects of a facsimile machine that may be 
used to practice the present invention. 

[002B] FIG. 2 contains a schematic Hlusiralion of the 
various elements of the present invention. 
[0029] FIG. 3 contains a detailed illustration of one 
45 embodiment of the image processing-compressors and 
their associated thresholds. 

rpoao] FIG. 4 contains a flow chart detailing the steps 
followed according to one embodiment of the decision 
logic device of the present invention. 
so [0031J FIG. 5 contains a schematic illustration of an 
ordinary JPEG compression that may be practiced by 
the present invention. 

[0032] FIG. 6 contains a schematic Illustration of a 
JPEG compression technique using approxknate val- 
ss ues as may be practiced by the present invention. 
[0033] FIG. 7 contains a schematic illustration of an- 
other JPEG compression technique using approximate 
values as may be practiced by the present invention. 
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[0034] FIG. B contains a schematic illustration of the 
a second GmbodirrtBnl of the present invention. 
[0035] The present invention Is directed to a method 
and apparatus lor compressing complex digital image 
oaia to enhance the efficiency ol data transmission. 
More specifically, the invention includes multiple data 
compressors, each of which operates at a different com- 
pression rale- The content of the blocks into which the 
image has been separated is continuously checked and 
the module that would be most appropriate lor process- 
ing the data is then selected based upon that content. 
[0036] Referring now to the drawings where the show- 
ings arG for the purpose of describing an embodiment 
of the invention and not for limiting same, FIG. 1 is a 
block diagram showing structure of an embodiment of a 
facsimile (fax) apparatus 10 according to the present in- 
vention. Fax machine 10 includes a CPU 12 for execut- 
ing controlling processes and facsimile transmission 
control procedures, a RAM 14 for controlling programs 
end a display console 16 with various buttons and/or 
switches tor controlling the facsimile apparatus and 
LCDs or LEDs for reviewing the status of system oper- 
ation. A scanner 20 is also mcludedtor acquiring an orig- 
inal image 28 and generating image data therefrom. Im- 
age processing unit 22 is Included to perform encoding 
and decoding (compression and decompression) proc- 
esses between an image signal and transmitted codes. 
While no specific location is required, the present inven- 
tion will typically reside in image processing unit 22. Sig- 
nificantly tor purposes of this invention, fax 10 includes 
or interfaces with a modem 24, which is a modulating 
and demodulating device that transmits and receives 
picture information over telephone fines to a compatible 
receiving device 26, such as anotherfacsimile machine, 
a printer, computer terminal or similar apparatus. As In- 
dicated, scanning via sending fax 10 is one way in which 
this image data may be acquired. However, those skilled 
in the art will recognize that other ways such file gener- 
ation using a computer and retrieving a digital file from 
storage arc also acceptable. 

[0037] The scanned image 29 is converted into imago 
data which indicates the intensity of the light throughout 
the original image. In the preferred embodiment, this im- 
age data will be digital data represented as picture ele- 
ments commonly known as 'pixels* 120 (illustrated in 
FIG. 2) which represent the intensity of light at discrete 
locations in ihe image. For example, a spot that Is cov- 
ered with black ink will not retted any light The value of 
the pixel 120 wifl typically be a minimum value (Le. 0) at 
that location. On the other hand, a spot that Is complete- 
ly uncovered by ink will reflect the color of the page on 
which the imags resides. Assuming the sheet paper on 
which ihe imags has been placed is white, the measured 
light intensity of the pixel 120 would be maximized at 
that spot A range of pixel intensity values between 0 
and 255 means that eight bits will be used to describe 
each pixel. Systems such as this are common in the art 
Thus, the maximum pixel intensfty value of often 255. 



Gray areas, such as those which represent color or 
black and white halftoned areas of the image would reg- 
ister a light intensity somewhere between 0 and 1. 
[O03S] Referring now to FIG. 2, image data which de- 

s scribes the entire acquired image is segmented into im- 
age data blocks 102. JPEG, which provides image data 
blocks 102 in the form of 6 x 8 pixel matrices has shown 
to be very successful when used with the present inven- 
tion, but the invention may be practiced with other com- 

™ presebn techniques and using image data blocks 102 
that have other dimensions. Those skilled in the art will 
recognize that a smaller or larger block size might be 
chosen when It is desired to preserve more or lass im- 
age detail. In fact it should be noted that while Ihe hor- 

15 izontal and vertical dknensrons are identical in the em- 
bodiment of image data block 1 02 described here, this 
is not a requirement for praciicng the present invention. 
For example, a non-square block might be chosen if the 
Image was generated for a device possessing asyrrv 

20 metric resolutions in the vertical and horizontal direc- 
tions. 

[0039] The present invention allows sending fax 1 0 or 
similar device to maintain the transmission speed of the 
associated modem by compressing the image data at 

2B different speeds as the content of the image data varies 
between Image data blocks 102. 
[0040] Still referring to FIG. 2, the invention also in- 
cludes several image processing modules M1 - M4. 
Whilethe invention will be described here with reference 

30 to four image processing modules, those skilled in the 
art will recognize that white at least two modules are re- 
quired, fewer or more than four modules can be used 
depending upon how wide a variation In Image repro- 
duction accuracy is desired, and that the Invention is not 

35 limited to the use of Tour modules. Modu !es M 1 • M4 win 
typically be compressors each of which processes the 
data at a different level of accuracy, thereby causing 
them to operate at a different rates of speed. For exam- 
ple, assuming that M1 produces the highest quality out- 

40 put, followed by M2, then M3, and that M4 has the great- 
est data loss, M1 will operate at the slowest speed, fol- 
lowed again by M2, then M3 and M4 will be the fastest 
It should be noted that while all of the modules are ca- 
pable of processing the image data, at least the fastest 

<s module must process it at a rate faster than tha modem 
speed in order to prevent disconnects. 
[0041] With continued reference to FIG- 2. the present 
invention also includes an image analyzer 104 which 
checks the content of each image data block 102 and 

so selects the most appropriate module for processing. Da- 
ta is then processed by the selected module and trans- 
mitted to receiving fax machine 26 by modem 24. More 
specifically, Image analyzer 1 04 first determines wheth- 
er the activity within the Wock - the amount of variation 

55 between the light intensity of the pixels contained the rs- 
tn - is high or low by mapping each block to the codeword 
that is linked to the image data that provides the closest 
match. High block activity means that image block 102 
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contains pictorial, multi-colored or other complex data, 
and that it should be reproduced by high quality produc- 
ing module such as M1 or M2. For Ihis type of data, 
processing psrformodbya tower quality outpuujng proc- 
essor would probably have a 6evere negative Impact on 
the visual appearance of the document. If block activity 
is low, ft is most likely that the document contains text, 
blank areas, or areas that are covered with a single 
color. Reproducing this type of date using a processor 
that may produce a lower quality output Is not likely to 
diminish the visual appearance of the document when 
viewed with only the human eye. 
[004 2] Vector quantization is an image processing 
technique in which K symbols that have N bite each are 
assigned to a single B bit codeword, where B < NK. For 
example sixteen eight-bit input strings might be as- 
signed to a twelve-bit codeword. "Thus, in this example, 
there will be enough codewords to represent only the 
4096 (2 12 ) most representative blocks of the sixteen in- 
put symbols. Codewords that are produced by vector 
coding are usuaJly stored or transmitted to another lo- 
cation or device, and are later decoded - mapped back 
- to K symbols. 

[0049] in the present invention, several image data 
blocks 102 are mapped lo a single codeword which rs 
an approximation of the Image data originally contained 
in input data block 102. Codewords have been pre- 
stored in a cod shook in the storage, transmission, or re- 
ceiving devices, and each codeword is associated with 
a set of pre-determined output image data. Thus, the 
codewords to which input data blocks 102 are mapped 
is that associated with data that will be closest tu that 
contained in the input data blocks 1 02 according to any 
reasonable distance measure. This mapping also con- 
tinuously indicates the level of activity within each block. 
[0044] Codewords, codebooks and the entire map- 
ping process are prepared in advance of operating the 
present invention. Thus, the only calculations that are 
required during operation are to compare input data 
blocks 102 to the codcbook and select the appropriate 
codeword. Also, an indication of which module should 
be selected to process Image data associated with K is 
attached to each codeword. For example, codewords to 
which pictorial, high activity image data blocks will be 
mapped will include data which indicates that module 
M1 should be selected to process that block. When sim- 
ple, single color text is being analyzed, the selected 
codeword will indicate that module M4 should be cho- 
sen. Thus, each codebook rs pre-stored with all neces- 
sary information and designations. 
[0045] Turning now to FIG. 3 for a general description 
Hierarchical Vector Quantization (HVQ), multiple N-bit 
symbols are mapped to a single B-bit codeword using 
a series of Look Up Tables [LUTs). As shown in the il- 
lustration, two N-bit symbols are mapped to an output 
cocteword 206 at th e first level using LUT 204. which has 
TP 1 entries. As shown, the total number of inputs is re- 
duced by a tact ex of two at the each level. As stated 



earlier, the process Is repealed until only one output re- 
mains, preferably by grouping codewords in a direction 
perpendicular to That U6ed for The previous level as in- 
dicated in FIG. 4, Repeating the process results in the 

5 mapping of larger and larger blocks of data to a single 
codeword. 

[0046) FIG. 5 contains a flow chart showing the oper- 
ating details of (mage analyser 1 04. Beginning with slep 
402 input image data block 102 is input To image ana- 

io lyzer 1 04 which, in the preferred embodiment of the in- 
vention, is a system based on HVQ. Each pair of N-bit 
inputs 202 is mapped to a single codeword 206 using a 
look up table 204 as indicated in stop 404. 
[0047] Grouping the N-bit inputs 202 into pairs and 

is outputlfng a single codeword 206 therefrom is the pre- 
ferred embodiment, but use of this configuration is not 
required to practice the invention. For example, if the 
shape of the input block or the chosen number of bits, 
suggests that grouping three or more N-bit inputs 202 

6 would be desirable, the invention could be adapted To 
accommodate this requirement. Further, if outputting 
muttipfe codewords 206 when more than two inputs 202 
have been grouped is somehow advantageous, the in- 
vention could be adapted to perform this task as well. 

55 What is necessary to reap the full benefits of the present 
invention is for the number of nputs 202 to exceed the 
number of codewords 206. Thus, while mapping five N- 
bil inputs 202 to three N-bit codewords 206 would be 
desirable, mapping three N-bit inputs 202 to five N-bit 

so codewords 206 would not typically be the best ap- 
proach. Referring tor a moment to FIG. 9, assuming that 
more than one codeword 206 has been generated by 
the initial stage division 6f image data block 102, the 
codewords produced in thlsfrrst stage must be grouped 

OS in pairs and a second LUT 20B must be used lo map 
each pair of resulting codewords 206 to a second stage 
codeword 210. This second mapping reduces the 
number of codewords 210 by a factor of two over the 
number of codewords 206 from the previous stage. The 

4° mapping parrs of codewords lo a eingle codeword in the 
next level continues in hierarchical taehton until all N bit 
inputs that make up image data block 102 can be 
mapped to a single codeword at the last level. That is, 
LUT stages must continue to be applied hierarchically 

46 to each pair of output codewords from the previous 
stage until a single output codeword 212 Is generated. 
Turning back to FIG. 5, is shown by the loop between 
steps 404, 406 and 406. It should be noted that a differ- 
ent LUT is used for mapping at each HVQ level. The 

so LUTs at all levels above the first have been designed 
such thai the inputs are codewords, rather than image 
data, The output from these higher level LUTs are code- 
words which represent tha input codewords. Once the 
number of output codewords has been reduced to one, 

ss mat final codeword 202 is used to represent an approx- 
imation of an entire image data block 102. 
[0048] Each codeword can be associated with a set 
of pre-determlned image data, and the codeword also 
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indicates the manner In which this predetermined im- 
age data should be processed. Mapping of input blocks 
202 to codewords 205 is performed by using LUT 204 
tD select the pre-determined image data eel whose con- 
tent is most slm liar to that of the input samples 202 berng 
processed. Similarly, mapping of the output codewords 
to higher level codewords Is performed by using LUTs 
20Q and 212 to select Lhe pre-determined image data 
sets that will appear the most similar according to any 
predetermined distance measure. Visual closeness 
when viewed wiih the human eye and some form of sta- 
tical analysis of the data contained in the block are 
two reasonable measurement criteria, but others are 
possible and the Invention is not limited to this embodi- 
ments Once the closest predetermined image data set 
has been located, the image processing instructions as- 
sociated with that data are used to select the module 
which will receive image data block 102. In other words, 
image data block 102 will be transmitted to the module 
that will process it according tolhe Instructions provided 
by the pre-determined image data that is most closely 
matched to iL Therefore, after a few stages of HVQ-re- 
lated LUT operations the output is a number which des- 
ignates the module that should be used to compress the 
image data block, and thereby determine lhe desired 
compression method. If the pre-determined approxima- 
tion contains high frequency information and detail, the 
image processing instructions will select the module 
with higher quality If the approximation describes a 
block without much detail a lower quality module may 
be selected. 

[D049] Referring now to FIG. 6, in the preferred em- 
bodiment, a standard JPEG compression will be applied 
to image data blocks 102 by one module (here de- 
scribed as M1 ) and will produce output data thai has the 
highest image quality. Thus, once the digital image is 
separated into 8x8 Image data blocks 102, image data 
block 1 02 is transformed using the discrete cosine trans- 
form (DCT) into a set 506 Of 8 X B coefficients as indi- 
cated in step 504, The DCT coefficient with the lowest 
frequency is referred to as the DC coefficient (DCC), and 
the remaining coefficients are AC coefficients (ACCs). 
The DCC and ACC6 are quantized - each coefficient is 
divided by a predetermined value referred to as the 
'step size" and rounded to a whole number at step 508 
and then a selected pattern (usually a "zigzag") is fol- 
lowed through the 8 x 8 block of quantized coefficients 
510 as indicated in step 512 to place lhe coefficients in 
a desired order in a one dimensional vector 514. The 
quantized DCC is typically the first value of the vector 
514. and b represented differentially as the actual DCC 
value minus the DCC of the previous block. 
[0050] Ordinary JPEG compression 13 completed with 
subsequent encoding of vector 514 into a bit stream 
through a sequence of Run Length Counting (RLC) op- 
erations which count the number of zero ACCs that re- 
side fn the path before a non-zero ACC. These RLC op- 
erations are combined with variable Length Codes 



(VLC) which encode a symbol that includes a combina- 
tion of the number of zeros preceding a non-zero ACC 
and the ACC amplitude. This encoding produces a com- 
pressed data stream which can be transmitted to a mui- 
£ tlpiexer 122 or other device which will select one output 
Tram multiple inputs, and send the data to a receiving 
fax machine or other device 26 over communication 
lines. 

[0051] In another embodiment of lhe invention mod- 

*P ule M4, which wilt produce the lowest quality output, will 
perform only the first step of the JPEG compression. 
That is, image dala block 102 will be subjected lo DCT 
After that, only the DCC will be quantized and that value 
will be sent to buffer 114. It should be noted that while 

15 this Image data will have the lowest image quaifty, it will 
be produced at the fastest rate. 
[0052] In yet another embodiment of the invention, the 
remaining modules, illustrated here as M2 and M3 will 
perform JPEG compression on "reduced" data sets - da- 

so ta that has been reduced in size from the originally pro- 
vided 8x8 block. Generally speaking, both M2 and M3 
generate' approximation data which provide estimated 
values of the pixels in image data block 102. Next, out- 
put image data is derived from the approximation data, 

& and the derived output image data i6 stored In buffer 1 1 4 
for subsequent transmission via modem 24, because 
the output dala is derived from approximation data, 
these modules produce output data that is less accurate 
- tower quality- than that produced by modu le Ml . Gen- 

30 ©rating the approximation data requires partitioning the 
image data block into a plurality of image data sub* 
blocks and representing each image data sub-block as 
a single value in an approximation data block. Deriving 
output image data from this generated data is part ormed 

os by applying standard JPEG lo lhe sel of approximation 
data. 

[0053] Turning to FIG. 7 for a detailed description of 
M2, image data block 102 is partitioned into sub-blocks 
610, Here, where en B x 8 image data block 102 has 

40 been provided, the preferred embodiment of the inven- 
tion includes partitioning image oata bkxik 1 02 into 4 x 
4 sub-blocks 6tO each having 4 pixels 120 arranged in 
a 2 x 2 pattern. Approximate values for each sub-block 
are then generated by representing each sub-block 610 

45 with a single value in an approximation data block 602. 
Those skilled in the art will recognize that these single 
value approximations can be obtained in many ways, 
such as averaging or adding the four pixels 120 in (he 
sub-block, or by using the minimum, maximum, median 

so or some other designated value. The remainder of the 
fmage processing by M2 is performed using ordinary 
JPEG compression. That is, approximation data block 
602 is transformed at BOA intoa blockof coefficients 606 
using the DCT. Coefficient block 606 is then quantized 

SS at 10S, and quantized coefficient block 610 is arranged 
into a one dimensional vector 5 1 4 which is encoded into 
a bit stream and sent to multiplexer 1 22 or a similar sin- 
gle output selecting device for transmission to a receiv- 
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ing fax machine or other device 26. 
[0054] Referring now to FIG. S, M3 operates very sim- 
ilarly to M2 with the difference being the magnitude of 
the approximation that takes place, and therefore the 
level of reduction In output image quality. As shown, im- 
age data block 102 Is again partitioned into sub-blocks 
710, but here the B *B image data block 102 is parti- 
tioned Into 2x2 sub-blocks 710 each having 1 6 pixels 
1 20 arranged In a 4 x 4 pattern. This approximation pro- 
vides for less accurate image reproduction than the em- 
bodiment described above with reference to FIG. 6, 
since more data loss can lake place. On the other hand, 
processing lakes place at an increased processing rate. 
As indicated earlier, image processing by module M3 
will be at a higher image quality level than M4, but 
processing will take longer. Approximate value sf or each 
sub-block are generated by representing each sub- 
block 710 with a single value in an approximation data 
block 602. Approximation data block 702 Is transformed 
at 704 into a block of coefficients 706 using the DCT. 
Coefficient block 706 is then quantized at 108. and 
quantized coefficient block 710 is arranged into a one 
dimensional vector 514 which is encoded into a bit 
stream and sent lo multiplexer 122 for transmission to 
a receiving fax machine 26. 

[0055] As explained earlier, one advantage of the 
present invention is the ability to tailor the size and 
shape of the blocks and sub-blocks to the needs of the 
user. Thus, image data blocks 102 can be locked tor 
transmission to module M1 or possibly module M2 when 
it is known that Ihe entire image being transmitted has 
a lot of fine detail and too much data would be lost with 
approximation. On the other hand, image data blocks 
102 could be locked for transmission to module M3 or 
M4 when the original image includes only text on a plain 
paper background. It should be noted again here that 
processing by module M4, which produces the lowest 
image quality output is not necessarily undesirable. In 
fact, this module should be used heavily when the orig- 
inal image contains smooth image data or blank con- 
stant areas, because fewer bits will be transmitted when 
the image has been processed. In other words, image 
quality will not be lost since there is less image data to 
process, and the approximations that occur in module 
M4 will produce fairty accurate results. 
[0056] It is, therefore, apparent that there has been 
provided in accordance with the present invention, a 
method and apparatus for analyzing Image data to effi- 
ciently use multiple transforms and enhance image data 
transmission that fully satisfies the aims and advantag- 
es hereinbefore set forth. 

[D057] According to a preferred embodiment of a 
method of improving the speed and efficiency of elec- 
tronic data transmission, the processing step comptisaB 
generating approximation data which provides an esti- 
mated value oJ said light intensity in said imago data 
block and deriving output Image data from said approx- 
imation data Said approximation data generation step 



further advantageously comprises partitioning said im- 
age dale block into a plurality ol image data sub-blocks 
and representing each image data sub-blockas asingle 
value in an approximation data block. 
5 [0058] Further, the output image data derivation step 
of a method of improving the speed and efficiency ol 
electronic data transmission preferably comprises 
transforming eaid approximalion data into a block of co- 
efficients, quantizing said coefficient block, arranging 
70 eaid quantized coefficient block into a one dimensional 
vector and encoding said one dimensional vector into a 
bit stream, thereby producing said output image data. 
[0059] According to a preferred embodiment of a 
method of improving the epeed and efficiency of elec- 
ts Ironic data transmission, the partitioning step comprises 
dividing said image data block Into sixteen image data 
sub-blocks, wherein four sub-blocke extend in a hori- 
zontal direction and four sub-blocks extend in a vertical 
direction. Said partitioning step further advantageously 
20 comprises dividing said image data block into four im- 
age data sub-blocks, wherein two sub-blocks extend in 
a horizontal direction and two eub-blocks extend in a 
vertical direction. 

[0060] According to an advantageous embodiment of 
2$ an apparatus for improving the speed and efficiency of 
electronic data transmission at (east one of said mod- 
ules further comprises an approximalion data generator 
which provides an estimated value of 6aid fight intensity 
in said image data block and output image data gener- 
ate ator which derives output image data from said approx- 
imation data. Said approximation data generator further 
preferably comprises a partiOoner which divides sal. im- 
age data block into a plurality of image data sub-bfocks 
and a simpiifior which represents each image data sub- 
as block as an approximate value in an approximation data 
block. 

[0061] Said output image data generator of an appa- 
ratus of improving the speed and efficiency of electronic 
data transmission further advantageously comprises 

4> means for transforming eaid approximation data into a 
block of coefficients, means for quantizing said coeffi- 
cient block, means for arranging said quantized coeffi- 
cient block into a one efimensional vector and means for 
encoding said one dimensional vector into a bit stream, 

45 thereby producing said output image data 

[D062] Further, said partttioner of an apparatus of im- 
proving the speed and efficiency of electronic data 
transmission preferably comprises means for dividing 
said image data block into sixteen image data sub- 

so blocks, wherein four sub-bfocte extend in a horizontal 
direction and four suo-btocks extend in a vertical direc- 
tion. 

[D063] According to an advantageous embodiment of 
an apparatus of improving the speed and efficiency of 
55 electronic data transmission, said partition er further 
comprises means for dividing said image data block into 
four image data sub-blocks, wherein two sub-blocks ex- 
tend in a horizontal direction and two sub-blocks extend 
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in a vertical direction. 



Claim* 

B 

1. A method of improving ihe speed and efficiency Of 
electronic data transmission, comprising the sieps 
of: 

a) acquiring input image data which rep resents 10 
the light intensity of an image; 

b) segmenting said input image data to form a 
plurality of image data blocks; 

c) selecting, based on 'an image content, a 
module for receipt of an input image data block; 
and 

d) processing said received image data block 
in said module. 

2. A method or improving the speed and efficiency of 50 
electronic data transmission as claimed in claim 1 
wherein said module selecting step further compris- 
es choosing one among a pJurality of image 
processing modules, wherein each image process- . 
ing module processes image data at a different im- 3* 
age quality leveL 

3. A method of improving the speed and efficiency of 
electronic data transmission as claimed in claim 2 
wherein said module selecting step furthercompris- w 

es: 

a) obtaining an image data block; 

b) mapping said image data block to a single 
codeword using at least one look up table; and ss 

c) transmitting said image data block to a mod- 
ule designated by said single codeword. 

4. A method of improving the speed and efficiency of 
electronic data transmieeion as claimed in claim 3 M 
wherein said mapping step further comprises: 



a) dividing said input data block into a plurality 
of samples; 

b) grouping said samples in pairs and repre- 
senting each sample pair with one codeword 
using a look up table; and 

c) linking each pair of said codewords to a next 
level codeword in hierarchical fashion using a 
look up table at each level until said image data 
block may be represented by a single code- 
word. 



45 



60 



A method of Improving ihe speed and efficiency ol 
electronic data transmission as claimed in claim 4 
wherein said processing step further comprises: 



block of coefficients; 

b) quantizing said coefficient block; 

c) arranging said quantized coefficient block In- 
to a one dimensional vector: and 

d) encoding said one dimensional vector into a 
bit stream, thereby producing a processed im- 
age data block. 

An apparatus for improving the speed and efficiency 
of electronic data transmission, comprising: 

a) a segmenter which divides irnagc data into 
a plurality of input image data blocks, wherein 
said image data corresponds to the light inten- 
sity ol an original image; 

b) a plurality of Image processing modules 
communicating with said segmenter, wherein 
any of said modules may process said seg- 
mented image data blocks; and 

c) an image analyzer communicating with said 
input image data blocks and with said modules 
to designate one of said modules for process- 
ing ol a segmented image data block, based 
upon a content of said segmented image data 
block. 

An apparatus as claimed in claim 6 wherein each 
of said image processing modules produces output 
Image data at a different image quality level. 

An apparatus tor improving the speed and efficiency 
of electronic data transmission as claimed in claim 
6 whereh said Image analyzer further comprises: 

a) an inpul data mapping device whfch maps 
each image data block to one codeword using 
a look up table; and 

b) a director which transmits said image data 
block 1o a module designated by said single 
codeword 

An apparatus for improving the speed and efficiency 
of electronic data transmission as claimed in claim 
6 wherein caid input data mapping device further 
comprises: 

a) segmenter which divides said input data 
block into a plurality of samples: 

b) binder which groups said samples In pairs 
and represents each sample pair with one 
codeword using a look up table; and 

c) a codeword mapping device which links pairs 
of said codewords to a next level codeword In 
hierarchical fashion using a look up table at 
each level until said Image data block may be 
represented by a single codeword. 



a) transforming said image data block into a 10. An apparatus for improving the speed and efficiency 
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of electronic data transmission as claimed in claim 
9 wherein at least one of said modules further com- 
prises: 

a) a converter which transforms said image da- s 
ta block Into a block of coefficients; 

b) a quantizer which divides each coefficient in 
said coefficient block by a predetermined value 
and rounds a resulting value to a whole 
number; ™ 

c) a sequencer which placee said coefficients 
in said quantized coefficient block into a one di- 
mensional vector; and 

d) an encoder which converts said one dimgn- 
sional vector into a bit stream. 15 
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